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ABSTRACT 


This Thesis considers the application of real-time digital informa- 
tion systems to the field of professional trading of commodities. 
Pertinent factors involved with the interfacing of a monitor system 
with a commodity exchange, and with professional trading interests, 
are considered. Skeletal functional Bue Ties of factual and predictive 
displays are proposed from the monitoring of a general peer environment 
to the monitoring of specific user positions in that environment. Ele- 
ments of a monitoring system are implemented on an IBM 360/67 configured 
with an IBM 2250 Graphic Display Unit operating with OS/MVT. Due to 
the highly subjective nature of commodity decision-making, a scarcity 
of relevant published information in this area, and the author's lack 
of extensive trading experience, this thesis addresses itself only to 
the acquisition, summarization and presentation of objective informa- 


tion. Any presumption of data interpretation is left to the user. 
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I. INTRODUCTION 


The commodity exchange approaches the economist's definition of a 
perfectly competitive market situation: prices are allowed to find an 
equilibrium level based solely upon what is believed to be the supply 
and demand. The exchange constitutes one of the most volatile market- 
places to be found anywhere in the world cede As a consequence, the 
opportunity to gain or lose huge amounts of capital exists daily. Such 
a situation attracts the speculator, and although the market does not 
specifically exist for such purposes, professional speculation serves a 
vital role in its function. 

A commodity is generally taken to be a raw or semi-finished good or 
an argicultural or geological origin. Typical commodities include: grains- 
wheat, corn and oats, metals = copper, stivies and platinum; meat = entele, 
chicken and hogs; and diverse items such as orange juice, eggs and cocoa. 
Major industrial and <zricultural entitles trade in these items, and 
many others, in more than a dozen special exchanges in the United States 
alone, trading on the order of hundred billion dollars per year. Price 
levels prevailing in these exchanges affect the American and even global 
economy at all levels from major corporations to the individual house- 
holder. 

Among the giant entities for whose purposes the exchanges actually 
exist, there are to be found more than a million speculative individuals 
and groups. Through a process known as "hedging", these individuals ac- 
cept the risks attendant to volatile price changes in return for the 
possibility of lucrative profit, and thereby act to insure the producer 


against unexpected future losses resulting fro: adverse price movement. 


ey 
* 


au “iviow fesaan lova) ey ta things 


i 


duktatont %o 47 


The entity which must buy or sell physical materials through the exchange 
desires to guarantee the net price at which the ultimate transaction will 
occur, and is willing to forego profits in order to avoid losses. 

The average speculator is willing to accept losses in order to ac- 
cept the possibility of profit, and he is not as obviously protected as 
is the hedger. The speculator is lured by the theoretical possibility 
of returning hundreds of percent per day on his risked capital. 

The basic vehicle of commodity speculation is the futures contract, 
which is, in essence, a binding promise to accept or deliver a warehouse 
receipt at some specified future date at a specified price, for a com- 
modity which often does not yet physically exist. A futures contract is 
frequently measured in units of many tons of material, generally valued 
at the mean prevaling market price of several thousands dollars. For 
this reason, control of a futures contract is acquired at a fraction of 
its full value, usually on the order of ten percent, (several hundred to 
a few thousand dollars), depending upon the commodity and current market 
conditions. 

The average price level of a commodity changes relatively slowly 
with time; however, the instantaneous price level is subject to minimal 
regulation, and is highly sensitive to factual and frequently fictional 
conditions of a highly diverse nature. As a consequence, the real price 
level can be subjected to extreme volatility during an active trading 
session. It is theoretically possible for the value of a contract to 
change by hundreds or even thousands of dollars in relatively few hours. 
Due to the high -leverage afforded by exchange margin policies, the rate 
of return is considerable for the speculator who maintains a favorable 
position in the market. Conversely, the disfavored speculator sees his 


margin rapidly absorbed by an adverse price transient. At some predefined 
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point, the latter individual must commit additional capital to a transient 

of unknown amplitude, or choose to lose both control of his contract and 

all capital committed thusfar. In an especially volatile situation, this 
decision might present itself in a very short time after he has taken his 
initial position. If the speculator chooses to fight an adverse trend, 

he could commit a vast amount of capital to cover his position (e.g., a 
"short" position in a "bull" market). Should the futures contract eventually 
mature before the market conforms to his original expectations, his loss 
could prove considerable. 

There exists an obvious motivation for the commodity speculator to 
stay abreast of market activities, virtually on a real-time basis. He must 
process considerable amounts of objective and subjective information of a 
highly complex nature, generated copiously by the one or more exchanges in 
which a sophisticated trader may be maintaining complex positions. While 
it is justifiably argued that successful speculating is largely intuitive, 
it is nevertheless true that much of the multiple data streams to which a 
speculator must expose himself could be preprocessed on a real-time basis, 
an obvious application for a digital computer. 

The use of computers in commodity trading for speculative purposes 
is in its Pe jodic stages at best, and it is presently confined largely 
to attempts at long-term trending. Sources of machine compatible data 
are limited at present, both in terms of historical data and its depth 


and peeadthe. The use of real-time systems is presently limited to two 


=eeandard and Poors of New York, long a supplier of such data to the 
securities industry, expects to release the first significant, reliable 
commodity data base in mid-1970. 
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major data petwortane whose systems basically perform the function the 
most recent state of a commodity or security for access via a basic 
display terminal. 

The purpose of this thesis shall be the presentation of various 
factors affecting the implementation of a more generalized management 
information system, and the presentation of elements which would constitute 
such an implementation. Certain basic elements will be demonstrated ina 
functional system discussed in the appendices; this system has been imple- 


mented on an IBM 360/67 configuration with (2250) graphic display facility. 


aUterenics Systems Corporation and Bunker-Ramo Corporation, both 
based in New York, maintain such networks in the United States. 
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II. SYSTEM OBJECTIVES 


The overall system has three functional objectives: 

1. To capture coherent, accurate information online from a 
raw data stream, as it is officially transmitted from the commodity ex- 
changes being monitored; 

2h To store and display this information in an appropriate 
time frame of reference in a readily understood format, and, 

Big To extend a forecast of expected narket movement into the 
immediate future, presuming that short-term market movement is (to a 
degree) non-random; it may therefore be described in statistical, rather 
than economic, terms. 

A system which will accomplish these objectives is proposed to con- 
sist of three elements: 

l. an Exchange Interface, that boundary across which informa- 
tion is received from the monitored exchanges; 

Ze a User Interface, that across which information passes to 
and requests are received from the commodity trader; and, 

3. a Data Management System, hereafter called "DMS", which 
acts to store and retrieve raw data, historical and predictive summaries 
and analyses, effect statistical forecasting, and process user requests 


for data display. 
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III, THE EXCHANGE INTERFACE 
NL ERFACE 


The Exchange Interface is that boundary across which information 
Passes to the DMS in a format suitable for the various analytic functions 
performed by the DMS. This data is received directly from the exchange 
being monitored, via a Pre-processor, 

Reporting Practices of the various commodity exchanges are similar, 
but are not Presented in a common format. For the sake of simplicity, 
only the Chicago Mercantile Exchange, one of the nation's largest com- 
modity exchanges, will be discussed, Unless otherwise Stated, all dis- 
cussion of exchange practice refers to that of the Chicago Mercantile 
Exchange, 

There are at least two methods of capturing information from the 
exchange. Both involve in-line Pre-processors. The most direct method 
involves the use of a text-editor in addition to the other software of 
the DMS. Another method involves a remote Pre-processing unit, perhaps 


serving many users, which actively transmits discrete units of informa- 


A pre-processor should produce, as a discrete “exchange information 
unit", or "EIU", the following: 
L. The commodity option in which the transaction has Occurred; 
De The value of the transaction in Standard units, specific 
to type of commodity; | 
s\ Pertinent qualifiers, denoting the Cransaction ag a bid, 
offer (ask), sale or volume report; 


4. The exact time, designated to the appropriate fractional 


second, at which the transaction occurred at the exchange, 
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The exchange reports transactions as they occur, with a priority 
being given to the currently most-actively-traded options. This informa- 
tion is transmitted over 40-baud Western Union X1050 lines, using a 
special code. The transmission media has remained essentially the same 
for decades, and many receiving units, or "tickers" still actively in 
use were designed, if not built, in the 1930's.> Such receiving units 
present the data as it is being recorded at and transmitted from the 
exchange. Such presentation is in the form of an alphanumeric text 
stream, representing qualitative and quantitative exchange activity. 

Human text editing is essentially too slow to interpret text for an 
automated system. It does have the advantage that it can smooth operator 
errors, more common in the earlier days of the transmission system. Al- 
though syntax errors are occasionally transmitted, the coding scheme ap- 
pears highly standardized, and observed errors in sample text has been 
rare. Text-editing software should, therefore, be relatively straight- 
forward. 

Cursory software study indicates a necessary trade-off between the 
efficiency and the simplicity of the text-editor. Simple string pattern- 
matching is straightforward, but the necessity of repeated pattern-matching 
scans to recognize the many valid character pattern results in heavy over- 
head. A more efficient procedure involves a bottom-up parse of an assumed 
precedence aeeeniei) in which the editor relates each character, as it is 


received, to those which it has already received. 


Syecteus Electric Corporation, Description and Adjustments of the 
Typewheel Tape Printer, 1934. 


ereddman. J. and Gries, D., "Translator Writing Systems", CACM, 
Vol. i, No. fae Pp V7oiilsy. 
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The system which performs the text-editing must also maintain a 


software-addressable clock for no other reason than to "time stamp" EIU's 
as they are extracted. In a small computer, real-time clocks are often 
available only at considerable additional expenses. Regardless of the 
type of the pre-processor, the EIU which it produces should contain at 
least the elements proposed above, in a standard format. 

A separate pre-processing unit would appear to be more economical, 
shared among many users, than a configuration which must support both 
pre-processing and other DMS functions. The pre-processor must have the 
highest priority in any configuration which it shares with other func- 
tions. Since the pre-processors operation is essentially random, it 
must interrupt other problem processing as textual elements are received. 
If enough potential users do not exist to support a separate facility, 
or if the pre-processing function is sufficiently simple, then a user 
might find it optimal to maintain all functions, including the expense 
of a clock, in one configuration. 

A possible source of pre-processed information might be those groups 
which presently operate real-time data banks for the securities industry. 
These networks gather and re-distribute data from many securities and 
commodity exchanges as it is produced. The data is stored on magnetic 
drums at regional data centers for access by Nixie-tube terminals and 
graphic display gtetionsee Little technical information was available 


to the author, but observation of their current mode of operation implies 


This was inferred by observation of an Ultronics satellite facility 
in San Francisco, California. 
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that there usefulness might be limited from the standpoint of a high- 
capacity analyzer. If the user must interrogate the regional data center 
for any large amount of data, especially on a continuous basis, then he 
might well find his system degraded through the request-queueing and 
message-handling procedure at the data center. Since, however, the 
regional data centers are being updated continuously by more central 
computer(s), the regional data center might maintain tables of users 

and information in which they are currently interested, and pass appro- 
priate data directly to the user. For the purposes of this paper, how- 
ever, three problems are as yet unresolved: 

1. Data formats designed for special terminals may not be conveni- 
ent as raw data for general processing. Special addressing data, graphic 
display orders and so forth may be only remotely related to the quantities 
which they represent. 

2. Time information may be relatively-oriented ("time-since-last- 
transaction"), rather than absolutely-oriented (""time-of-last transaction"), 
which may prove inconvenient. 

3. While securities exchanges maintain elaborate computer systems 
which may, in turn, feed the data network's distribution system, most 
commodity exchanges do not appear to do so. Since the network is then 
dependent upon the same ticker as is the user, one must examine the means 
(in:terms of speed and accuracy) by which the network translates this text 
into distributable for. 

Terminals are now being introduced which do perform certain active 
monitoring functions, one of which will monitor as many as eighteen 
separate issues and alert the user if user-set limits are ceeded.” 


Srnis function is currently available on the Ultronics 'Videomaster" 
graphic display terminal as an option. 
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This function is essentially instantaneous in time; the system does not 
maintain historical information. If tables of such limits are maintained 
at the regional center, as would seem proable, then it is not required 
that the network transmit actively to the terminal unless a breakout 


occurs, removing even that degree of activity. 
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IV. THE USER INTERFACE 


The User Interface addresses two basic problems: 
1. What constitutes useful information to the user; and, 


Drs What is the optimal display medium and format. 


A. DISCUSSION OF "USEFUL INFORMATION", 

The question of what constitutes useful information is highly sub- 
jective in any situation. A few years ago, Westinghouse Electric Corpora- 
tion abandoned the idea of equipping all of its top-level executives with 
desk-side terminals presenting "real-time" information. The reason given 
was that "...few of the top managers could tell...what kind of informa- 
tion they wanted--or what they would do with it if they had it. When 
a few veteran commodity traders were queried concerning the types of 
“real-time information" that they would like to see presented, the results 
were similar. It is difficult to draw even vague general conclusions 
about the industry, since, (as an authority on commodity trading notes:) 

"It is at least unfortunate that the commodity markets have 

had the skimpy attention given them by business writers to 

this point. Bookstore shelves groan under the weight of in- 

numerable, well-executed volumes dealing with virtually every 

other facet of economics. But the seeker of useful informa- 

tion about commodity markets can carry the full selection 

available home under one arm. This, in spite of the fact 

that we are dealing with something in excess of a $100 billion 

annual trading volume." 


It becomes apparent that "useful commodity information" has yet to 


be defined objectively, especially information of a high interpretive 


pallexinder Ts. "Computers Can't Solve Everything", Fortune, V. 80, 
p. 128, October, 1969. 


peeiveali L., Charting Commodity Price Behavior, p. 3, Commodity 
Press, 1969. 
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nature. However, much remains to be done in the simple reporting and 
condensing of exchange data, and performing statistical extrapolations 
with such data with short enough delay time to be useful to an active 
trader. It is proposed that, in order of importance, an integrated 
system should present: 

le The immediate situation, i.e., that last transactions in rele- 
vent contracts as soon as possible after they occur. Many professional ; 
traders have direct telephone lines to the exchange floor to minimize 
this delay time. 

Ze The relevent historical situation, presented for comparison 
purposes in a readily understood format. This history should definitely 
include the current trading sessions transactions, and may include im- 
mediate access to the daily summary over the entire life of an option. 

as The expected situation for the remainder of the trading ses- 
sion, based primarily upon statistical considerations, presented in an 
easily understood format. Economic considerations are excluded, due to 
the relatively short time-span involved. It is expected that the ex- 
perienced trader will be apprised of over-riding economic considerations 
in the market in which he is trading. It is also expected that he will 
make subjective allowance for these factors in interpreting all avail- 
able data, including statistical expectations. 

Simple systems which present a picture of the immediate situation, 
from the viewpoint of the general market, have been available for years. 
However, presentation of the market situation from the standpoint of a 
particular user is not so easy, especially from a human standpoint. In 


complicated market positions, such as "spreads" and "straddles", one is 
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frequently concerned by differences between two or more price trends. 

As the number of such complicated positions increases, one may find that 
he is soon limited by the number of positions which he can adequately 
watch. Presentation of such information, once his position(s) can be 
defined for a machine, is a relatively straightforward matter. 

Presentation of the historical 'market-oriented" situation is also 
fairly straightforward. One is simply displaying stored past data as 
received across the Exchange Interface. If the system has been consist- 
ently analyzing the market-oriented situation from the standpoint of the 
user's position(s), and storing this information, then a “user-oriented" 
situation may be readily presented. 

Presentation of an expected situation can become quite complex in 
terms of the possible statistics involved. The availability of real-time 
analysis suggests certain validity to the assumption that statistical 
extrapolation alone is sufficient for a first-approximation, short-range 
forecest. If one imparts a certain degree of "inertia" to a market as 
complex as a commodity exchange, and if the lead time of the forecast is 
sufficiently short, then a statistical approximation may prove at least 
useful to the Gears (Human psychology and economics are, to be sure, 
critical market factors. However, modeling their effects objectively 
would prove extremely difficult, and would result in a heuristic evalua- 


tion process, which for the sake of brevity is not explored here.) 


B. DISCUSSION OF DISPLAY FORMAT. 

In this business, one appears not as interested in permanence of 
information as he is in its rapid and reliable availability. Since 
decisions appear to be required in "real time'' there is nothi:z more dead 


than the detailed transactions on yesterday's market, except to the degree 


7 see Appendix B. 18 
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that they indicate those of the rest of today. A paper tape ticker fre- 
quently falls directly into a wastebasket. The ticker is reliable and 
fast, and presents a crude information retrieval system, which is why it 
has been in use for so long amid increasingly sophisticated information 
media. One might conclude that hardcopy is a convenient by-product, not 
essential in itself. 

An ideal information display device is a cathode ray tube, or graphic 
display terminal. The most common terminals available today are limited 
to textual display. Such units limit one to alphanumeric displays, and 
therefore to a digital rather than analog display. If one must display 
information symbolically, then he must confine himself to the symbol set 
which is readily understood by the user. The symbo’ism required to des- 
cribe historical and expected trends, especially if complex statistical 
method are involved, may not be familiar to the traditional user. If the 
statistical significance of such reductions is not readily and accurately 
understood, then the system may well be ignored in the pressure of daily 
trading. 

The old adage, "A picture is worth a thousand words", is especially 
true in this general situation, and therefore dictates some form of analog, 
or graphic bane Sar tea cion: Graphic display units with a vector-generating 
capability have generally been far more expensive than those which merely 


generate characters, selling from $8,000 to over $100,000 per egy 


100he implementation on which this system was demonstrated consisted 
of an IBM 360/67 configured with a 2250-1 graphic display unit. The latter 
element reatils for over $100,000 and the overall installation above $4 
million. However, Textronix, Inc., of Beaverton, Oregon, to cite one ex- 
ample, has introduced an essentially similar display unit for $8,000. 
Viatron Computer Systems Corp., of Bedford, Massachusetts, again to cite 
but one example, retails sufficiently sophisticated computers in the $4,000 
to $10,000 range to perform all functions described in this thesis. Such 
prices are typical of trends in the industry. 
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Prices for these units are rapidly decreasing, and under lease system, 
implementation costs could prove quite reasonable in the near future. 

The concept of an optimal display format is largely subjective, one 
which has been implemented for the purposes of this thesis consists of a 
resident image, which permanently displays vector elements common to all 
displays, with two types of graphic overlays: 

Ls An overlay containing all historical graphic and alphanumeric 
information. Historical graphs depict all the current session's trans- 
action and volume reports. Alphanumeric information specifies the last 
transaction received, its type, numerical value and time of arrival. 

2s An overlay containing all predictive graphic and alphanumeric 
information. Predictive graphs depict an extrapolated expected market 
trend based upon all transactions received to the present, projected for- 
ward from the time of the last received transaction. Alphanumeric in- 
formation depicts significant parameters in statistical equations, which 
may be modified by the user, if necessary, to change the response rate and 
stability of the model. 

The above representation permits only one option to be displayed at 
one time. Existing text-display terminals display a number of options of 
interest to the user simultaneously. However, the amount of information 
displayed is limited. Such a display is useful, and its inclusion is 


relatively straightforward. 
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V. THE DATA MANAGEMENT SYSTEM 


The Data Management System functions in basically two states: 

il A Transient State, during periods of initiallization and shut- 
down; and, 

2. A Steady State, which is considered to be the normal mode of 


operation. 


As TRANSIENT CONSIDERATIONS 

The Transient State at initiallization can be classes as: 

1. <A "coldstart" situation, in which the system is being initial- 
lized before the trading session opens; and, 

2c/° A tek ai situation, in which the system must be restarted 
during a trading session. 

The "coldstart" situation is relatively straightforward for two 
reasons: 

First, both the Exchange and User Interfaces are essentially in- 
active, placing no time or priority processing constraints upon the 
system. Initiallization of system tables and parameters may occur at 
the leisure of both the system and the user. 

Second, there is no information in the system which might be im- 
mediately required, or which requires immediate or completed processing. 

The "warmstart" situation is more critical. Since it is defined to 
occur during a trading session, it is likely that both the Exchange and 
User Interfaces will be highly active, regardless of whether the syste: 
is functional. The pre-processor is transmitting to the DMS interface 


buffer and if some standby arrangement does not provide for storage of 
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this information (required to continue trend analysis), it will be lost. 

If the pre-processor is remote to the system, then the facility may exist 
to request lost information. If the pre-processor is an integral part 

of the DMS, then the "raw" text stream will be lost, and at this time, no 
facility exists to request "backup transmissions" over the ticker line. 

In practice, the activity on the Exchange Interface is not under control 

of the DMS or the user. Activity on the User Interface is obviously under 
control of the user; however, this is small consolation when the system 

is not providing vital information. In a "warmstart" situation, there must 
exist both a means of rapidly bootstrapping the DMS, and sufficient backup 
storage to re-initiallize resident core-storage tables and resident graphic 
buffers. Since graphic overlay files are resident on direct-access units, 
a large fraction of the system's information will not be damaged. 

The Transient State at shutdown can be classes as: 

1. A normal system termination, which occurs after the trading 
session is over; and, 

Ze An abnormal system termination, which occurs during the trading 
session through hardware or software failure. 

The normal termination is straightforward, as it permits the system 
sufficient te to save pertinent information at its leisure. Since it 
will presumably be followed by a "coldstart", there is no requirement 
that information be saved in such a manner as to permit rapid re-starting 
of the system. | 

An abnormal termination is a more critical situation. Since a "warm- 
start" should follow this event, all considerations discussed above apply. 
An overriding factor is the length of time the system will take to "catch 


up'' with the market once it is restarted, and this governs the amount of 
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information which must be stored as backup. Most of the system's efforts 
up until abnormal termination have involved statistical analysis and up- 
dating of graphic overlay files. Since these functions occur with the 
reception of each “information unit" from the pre-processor, and since 
such information resides on direct-access devices, it will be current for 
all monitored options, and will not be lost upon termination. The DMS 
should be designed such that core-resident tables are essentially static, 
serving to address direct-access files upon which all dynamic option-specific 
information is stored. Such tables may be restored from backup copies on 
direct-access files. Resident graphic displays should contain minimal 
dynamic information that cannot be immediately updated by incoming EIU's, 
or by access to resident files. Such information includes the last trans- 
action for an option, and the current time. 

All routines used in the transient state may be overlaid in core as 


called by the DMS. 


B. STEADY-STATE CONSIDERATIONS 

In Steady-State operation, the system functions at one of eight 
Prior’ ty Levels, each encompassing one task. At each Priority Level, the 
DMS maintains a Task Status Block, which contains pertinent information 
about the task. This block permits a task to be interrupted and restarted 
by the DMS Resident Monitor, should transfer of control to other Priority 
Levels become necessary. The DMS neaidene Monitor, should transfer of 
control to other Priority Levels become necessary. The DMS Resident 
Monitor Preceeuse iicercipts from the Exchange and User Interfaces, and 
passes control to appropriate interrupt levels. It provides any complex 


scheduling other than sequential, that a more advanced DMS might require. 
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The Priority Levels are summarized as follows; in order of urgency: 
af Processing interrupts from the Exchange Interface; 
2s Processing interrupts from the User Interface; 
a Updating historical graphic overlay files; 
4. Analysis of user's position relative to current market; 
5s Updating predictive graphic overlay files; 
6. Analysis of user's position relative to Vagpected” market; 
re Recommended "“optimal'' market positions (optional); and, 
8. Idle state. 
ihe Priority Level One: Exchange Interface 

Priority Level one is assigned to the Exchange Inter- 
face. This priority level pre-empts all other DMS functions because the 
EIU from the pre-processor must be transferred from the DMS interface 
buffer before the arrival of the next EIU. This Level may be entered 
only upon receipt of a hardware interrupt from the Exchange Interface 
of the DMS. 

The task will perform the following functions: 

a. Transfer EIU from interface buffer to sequential 
backup storage; 

be Extract "time-stamp" from EIU. If the DMS requires 
the current time for display or other reasons, this should be within a 
few seconds of the correct time. 

c. If the DMS is not monitoring this option, return con- 
trol to Resident Monitor. This might be auickly determined by "hash- 
addressing" the commodity option mnemonic, and checking a suitable 
table-entry for its presence. Such a table might also contain direct 


access file information for other tasks. 
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Oe If the option is being monitored, then its internal 
identification is its setae hs Convert any qualifiers and numerical 
representation in the EIU to internal representation, and return control 
to the Resident Monitor. 

Priority Level one may not be interrupted during execution, except 
by system failure. 
2. Priority Level Two: The User Interface. 

Priority Level two is assigned to the User Interface. It 
is given control when the user requests one of the following three actions: 

a. A change in the active graphic display; 

b. A change in those system parameters which may be 
dynamically modified; or, 

c. A change in the user's specific position. 

Level two may be entered only by an interrupt from the 
User Interface, and may be pre-empted while in excecution only by Level 
one. Upon user command, this task will: 

a. Retrieve appropriate graphic overlays from direct- 


access storage and display them from the graphic display unit buffer, 


whenever a display change is required. 


ll, "hash-address" or "hash code" involves the use of a data element's 


structure to calculate a unique table or file address for an elements of 
that exact structure. In this demonstrated implementation, a hash code 
is generated by adding together the integer representations of the EBCDIC 
characters in the option mnemonic for a commodity, and performing a 
modulo-19 operation, generating an address between O and 19 inclusive. 
This operation is much faster than scanning a table of nineteen entries 
for a matching character pattern. The savings becomes far more signifi- 
cant if the system must rapidly compare a mnemonic against dozens or even 
hundreds of valid patterns. This technique for generating hash addresses 
is one of many. See Morris, R., "Scatter Storage Techniques", CACM, 
Volt. 11, No.ll,:p. 38-44. 
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b. Update appropriate table and graphic files, re- 
initiallizing statistical data as necessary whenever a system parameter 
is modified. 

Cc Service requests for a change in the user's specific 
position by allocating or releasing core and direct-access storage devoted 
to the affected positions, and initiallizing analysis of new positions 
with respect to the market. 

This task is given second level priority for two reasons: 

ae In most cases, only a change in display will be re- 
quested. If complete graphic overlays can be paged as one physical re- 
cord, then execution of these requests will require relatively few 
machine cycles. It is presumed that once the graphic overlay is in the 
display unit buffer, the DMS is finished with the request. 

b. The primary purpose of the system is to display and 
maintain information of immediate use to the user. 

se Priority Level Three: Historical Graphic Update General 

Priority Level Three is assigned the task of updating 
relevent historical graphic overlay files. The Resident Monitor of the 
DMS transfers control to this level following execution of a level-one 
task if the level-two task is not pending completion. This task per- 
forms the following functions: 

a. Find, load into core and update the relevent histori- 
cal overlay. 

b. If this overlay is being actively displayed, transfer 
a copy of the overlay to the hteoaey unit buffer. 

Cc. Transfer the overlay back to direct-access storage, 


and return control to Resident Monitor. 
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This task should execute relatively fast if: 


a. The overlay is stored upon direct-access device as 
one physical record, and may be transferred as such; and, 

b. Graphic orders are generated by core-resident routines. 

4, Priority Level Four: Historical Graphic Update, Specific 

Priority Level Four essentially analyzes all user positions 
involving that option reported upon by the last EIU and updates graphic 
files describing each position accordingly. This task executes in a 
manner similar to that at Level Three. 

Constraints affecting the efficiency of this task are 
similar to those of Level Three, with an added constraint relating to the 
number of positions which must be analyzed. Since information is merely 
added to appropriate graphic order files, as in Level Three, the process 
should be relatively efficient. 

5. Priority Level Five: Predictive Graphic Update, General 

Priority Level Five is assigned the task of updating 
relevant predictive graphic overlay files. It performs the following 
‘functions: 

a. Find, load into core and extract statistical data 
stored with file. 

b. Using statistical data, recursively determine new 
statistics and replace in record image. Utilize new statistics to deter- 
mine co-efficients for forecast model equation. 

c. Regenerate entire graphic overlay file from "current" 
point on overlay's time axis, using forecast equation. 

d. If overlay is being actively displayed, transfer a 


copy of overlay to display device buffer. 
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e. Transfer record image back to direct-access storage, 
and return control to Resident Monitor. 

The efficiency of this operation is subject to the same 
constraints as Level Three, with the added constraint that the type of 
forecasting and the amount of calculation necessary to generate forecast 
points is important. 

This task is placed at level five because it is felt that 
statistical prediction of market trends is subordinate to factual cur- 
rent market data, especially to one who is maintaining an active position. 

6. Priority Level Six: Predictive Graphic Update, Specific. 

Priority Level Six analyzes each relevant market position, 
as in Level Five, for its expected net value in light of the new informa- 
tion. Each overlay file must maintain updated co-efficients for the fore- 
cast equations of each commodity option involved in the position; these 
co-efficients must be updated for the specific option involv-d. The net 
expected value of the position as a function of time is in turn a func- 
tion of these equations, plus other pertinent data such a commissions, 
carrying charges and so forth, The expected position must be regenerated 
from the "current" point on the time axis of the display, using this 
equation, in a manner similar to Level Five. If the system is actively 
monitoring price limits, then it would determine the time at which the 
limits will be reached, if it appears that they will be reached during 
the current session. 

Tin Priority Level Seven: Strategy Recommendation. 
Level Seven examines the expected movement of all moni- 


tored commodity options to suggest optimal market positions, especially 
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in more complex areas such as spreads or straddles. The discussion of 
this option is limited to that of a "blue-sky" suggestion since its 
implementation would be complex. Hemev as the information does exist, 
following completion of the task at Level Five, to determine optimal 
strategies based upon expected movement. 

boy Priority Level Eight is essentially an idle state, at 
which the Resident Monitor awaits higher level interrupts. 

Scheduling among priority levels is essentially sequential, 
in which control is passed to the neke lower priority level as higher 
level functions are completed. An obvious danger with this type of 
scheduling results if Exchange and the inter-arrival time of or User 
interrupts is shorter than the time required for the system to naturally 
progress to lower levels. Priority Levels below which the system, on the 
average, has time to reach, will never be completed. Therefore, the 
Resident Monitor may have to determine, on the basis of mean inter-arrival 
rate, and mean task completion time, exactly how low in its priority-level 
hierarchy it will schedule tasks. The scheduling can then become dynamic 


and quite complex. 


C. ACTIVE MONITOR FUNCTIONS 

As discussed above, the DMS performs a basically passive function, 
compiling and presenting graphic data on request. The DMS could play an 
active role by accepting limits of interest to the user, and notifying 
the user when: 

ia EG is expected that the limits will be exceeded in the current 
session, and when those limits will be exceeded; and 


2 Limits are actually exceeded in trading. 
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This function could be performed for both the general market, and for 
specific user positions. Such active functions are implemented on com- 
mercial system now, although only in the sense of (2) above. They re- 
lieve the user of much of the effort of constantly watching tapes and 


displays and trying to guess the significance of trends. 


D. NON-SESSION FUNCTIONS 

A commodity exchange is active a relatively small percentage of the 
time. When the exchange is active, the full resources of the system may 
be devoted to some or all of the functions in (B) above. However, there 
are at least twenty hours a day when the exchange is not active, and during 
which the system may be devoted to other functions. 

An obvious function involves optimization of statistical methods or 
parameters used during active session, based upon "raw'' EIU's stored at 
Priority Level One during previous sessions. 

Another function involves statistical processing of longer-range 
data, searching for correlations between such diverse fundamental factors 
as weather, crop-reports, unused stocks and so forth, and such technical 
factors as volume and open interest trends. Such information might be 
summarized as graphic displays which may be paged from direct-access file 
for reference to the longer-term fundamental or technical situation. 
Forecasts for several days might be available to the user in interpreting 


the significance of emerging trends during a trading session. 
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VI. SUMMARY 


In summation, it has been proposed that a functional digital informa- 
tion system may be composed of 

he An interface with the official media of specific exchanges, 
through a pre-processing unit which converts various exchange data for- 
mats to a standardized format, which includes time of origin. 

Vag An interface with the user through an interactive vector- 
generating graphic display conninal. by which he may request suitably 
summarized information concerning the market environment and his specific 
position in that environmer.. 

a An operating system which maintains graphic order files 
on direct-access storage of an historical (e.g., factual) and predictive 
nature, as a series of user-callable graphic overlays, performing suit- 
able statistical and graphic updates as new information is received. 

The author does not possess the extensive trading or economic 
knowledge which would be required to suggest specific online interpre- 
tive functions of a heuristic rather than statistical nature. They would 
be the subject of much more sophisticated work in the embryonic applica- 
tion of information technology. It might be noted that any heuristic 
system which attempted to determine market patterns by observation of 
large masses of data would find such data to be largely non-existent, 
except in a daily summary of minimal detail. Previously demonstrated 
calculations imply that offline storage requirements for the inforn ion 
transmitted by the official exchange media are not excessive. It would 
appear that profitable work remains to be done in the fields of simply 


getting useful, machine compatible information to potential users, A 
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secondary, but ultimate purpose involves the presentation of better 
information to the professional trading interests in sufficient time to 


be of use in market decisions. 
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VII. CONCLUSIONS 


A number of final observations have resulted from work thusfar con- 
cerning a Monitor System. 

Since volume reports arrive once every half hour, it would appear 
that volume predice lene would be of limited accuracy or usefulness. It 
would further appear that the volume of data is sufficiently low hoe a 
mere factual presentation is sufficient, and that the user should draw 
appropriate conclusions from this data alone. Considerable work remains 
to be done designing a text editor which is capable of processing a 
general text stream for a particular exchange. 

The problems involved in statistical forecasting (aside from any 
economic or psychological considerations) have received but cursory at- 
tention in this thesis. "Exponential smoothing" is not the only feasible 
approach to statistical forecasting; some might maintain that it is far 
from the best. Even this form of smoothing has not been exhaustively 
treated in this work. Study remains in the areas of minimizing both 
variance and confidence intervals for projections, which this implementa- 
tion does not do, and conveying this information to the user, perhaps as 
a graphically-displayed "confidence envelope" about a projected forecast. 

Proposed in a general manner has been the subject of analysis of 
specific user positions in a market. There remains the detailed design 
of software to permit the entry, deletion, modification and storage of 
user positions, optimized from the standpoint of time and storage. At- 
tendant to this is the summarization of all factors affecting the net 


value of various types of positions, including carrying charges, brokerage 
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and exchange fees, and so forth. A useful interactive facility, if the 
system's excess capacity permitted, would permit the user to study the 
net present and expected value of shifts in positions and combinations 


thereof, consistent with charges and fees such as those mentioned above. 
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APPENDIX A 


CHICAGO MERCANTILE EXCHANGE 
STANDARD TRANSMISSION MNEMONICS 
Approximately five major types of information are transmitted over 
the official Chicago Mercantile Exchange line, as standardized mnemonic 


codes. These are as follows: 


A. CONTRACT OPTION DESIGNATION, 

A futures contract option (maturity date of a futures contract) is 
designated through the concatenation of a one-or two-character mnemonic 
indicating the specific option, and a one-character mnemonic indicating 


the month of maturity of the contract. Important standard mnemonics are: 


COMMODITY | MATURITY 


Butter January F 
Eggs February G 
Live Cattle March H 
Live Hogs April J 
Frozen Pork Bellies May K 
Idaho Potatoes June M 
July N 
August Q 
Septzmber U 
October Vv 
November X 
December Z 


For example, February Egg futures would be designated as "EG", and 
March Live Cattle futures would be desfgnated as "'LCH", 
In cases in which the year of maturity is not immediately obvious, 


the year will be concatenated onto the aggregate mnemonic defined above. 


B. ACTION SPECIFICATION 


An action is specified by a numerical value, preceeded by a qualifier, 
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if appropriate. It refers to the last futures contract option designated 
in the data stream. 
te Numerical Value. 

The numerical value generally consists of an integer portion 
concatenated with a two-place decimal fraction. Its unit of measure- 
ment is in hundredths of a dollar (i.e., in cents), and is a price at- 
tached to one standard specific unit (e.g., pounds, troy ounces, bushels, 
etc.), of the designated futures option. (It is not the price of one 
full contract, the minimum sowren unit, which may be defined in terms of 
thousands of such specific standard units.). The numerical value specifies 
this price to the nearest one-hundredth of a cent (or "point"). In 
certain instances, the fractional portion may be transmitted as one of 
seven rational fraction, expressed in increments of one-eighth of a cent. 
This has not been observed in normal transmission of trading actions, 
however, but rather to report summary data. 

For example, a reference to an option of pork bellies (raw 
bacon futures) at thirty-five cents per pound would be transmitted as 
"35.00" in the data stream. 

2. Qualifiers 

A qualifier may consist of one of four types, and indicates 
the nature of the numerical value which immediately follows it. 

a. A completed sale is indicated by the absence of any 
qualifiers, rather, the numberical value of the price at which the sale 
occurred is transmitted. 

b. A bid (an offer to buy) ("bid") tendered at a price given 
by the numerical value is indicated by the character "B" immediately pre- 


ceeding that rumerical value. 


36 


7" 


Ste f® ei. ; SP 

aeenliend 2050 rm, , abouow , : ; 7 
wre 44 3 2 ion 22.391) : 1 pus ‘4 

So mires 5 u mish sv Vr AArCwW 32 Dag wa? ; 3 

Ae Pons ay ' aalronun oni f 23 busin slitsage fags 


‘ i . C 2h oon" "OJ 1M7BD . bia r'yls nut wh : - Te, od 


: 20 31D 8h e223 firsts et VEm mei itogG ‘nadorjoeus) 413 *oenktent 


-) S7a5 «@ Yo. Atdigtc+ono jo sinemaron! ;: SBE F712 roscoeet Leaee 

pORGFIoB anibexs Jo ookeetee v0 LMMOT Gl SoVtsedo Aged 

r) » ; Pitt 5 ise j:onss o°3 73/00 aude 
= 

7 | 7 
# 


ca : 
why ) Ea ES i _— NLOS te no] 4 B O03 Asher el ss , , ‘7 4au3 yoY ’ 
ae Gelso teerragd! St oiidw bAyoq req situss avet-ysuadls ie (es 


Wae7wse njseb aaa 


PSPeoIeii DAG) .AO0VF ttl to’ one ' 20 gatet"> van 1slillianp & 
22 BW0 502 Cisiabisre satde suley Ipolbrewmn sid 
Wie. 26. Sonpede gifs "¢ late simi! 21 Wiles batainmas A 


; S2N8, SA? Avitly de solig oc) 7 nv leatt+edeuns saa tetIet @ 


c. An offer to sell ("ask") at a price indicated by the numeri- 
cal value is transmitted with Phe charaecee "A" immediately preceeding 
that numerical value. 

Numerical values, qualifiers and futures option designations are 
usually separated by two or more dots in cases where confusion might other- 
wise result. Moreover, characters are printed in one of two parallel text 
lines on the tape, depending upon the nature of the character, for ease 
in reading the tape. The transmitted data for a hypothetical text stream 
might be: 

eC EB. 43620 «0085 I0 0s chs 644100, 6c Bch Se 20.0 chai 2 cir 
This data stream would indicate that all further data would refer to the 
March option of Frozen Pork Bellies (PBH), until another valid "contract 
option designation" occurred. A completed sale is reported at 43.27 cents 
per pound (for an unspecified number of contracts), and anothes sale is 
reported at 43.30 cents per pound. A prospective seller then offers to 
buy at 43.20 cents per pound. Another sale is reported at 43.25 cents 
per pound. 

There is no pre-defined order in which market actions are re- 
ported, nor may all market actions be reported. A transmission priority 


is given to the currently most active options. 


C. VOLUME SPECIFICATIONS 

Every half hour, between 10:00 and 1:00 p.m. inclusive, the Chicago 
Mercantile Exchange reports cumulative volume figures broken down by 
specific options for the current tradilng session. This information is 


preceeded by the mnemonic ".SALES,TO" in the data stream followed by the 
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time in one to four digits, as appropriate. The succeeding data stream 
then consists of contract option designations and integral cumulative 
sales figures (for that session). This series is broekn by two or more 
dots, which might be taken by an algorithmic text editor to terminate 


the volume report. 


D. j$TIME DISIGNATIONS. 

Every five minutes, the Chicago Mercantile Exchange transmits the 
current Chicago time. The time desionacion consists of one to four 
digits, as appropriate, concatenated to the mnemonic "AM." or "PM.", 


again as appropriate. 


E. CORRECTION DESIGNATIONS 

Two types of corrections have been observed in sample data streams: 

1. Previous Entry Deletion 

The following mnemonic pattern is transmitted to delete pre- 
vious entries in the data stream: 
"CANCEL, LAST" + xxx + yyyyyy, 

in which, xxx represents the contract option designation; and, yyyyyy 
represents the numeric value and qualifier (if any) of the option to be 


deleted. 


Ze Previous Entry Substitution 


The following mnemonic pattern is transmitted to correct pre- 
vious erroneous entries in the data stream: 
"MAKE.LAST" + xxx + yyyyyy + "READ" + zzzzzz, 
in which, xxx and yyyyyy are defined as above; iar zZZzzzz represents the 


corrected value to be substituted. 
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APPENDIX B 
STATISTICAL FORECASTING 


A. DISCUSSION OF THEORY 

Statistical forecasting is based, to an extent, upon the assumption 
that any dynamic physical process may be described in its relevant dimen- 
sions by purely mathematical models. Given a suitable model, all of its 
parameters may be determined by observation of the original process. 

Once those parameters have been determined, then the future behavior of 
the process is presumed to be described by the model. For the purposes 
of this thesis, the problem is three-fold: 

1. The determination of dynamic state equations of the process as 
a function of all relevant dimensions; since this model is primarily time- 
dependent, it will be assumed that the model is described as a function 
of time only. 

Zs The employment of suitable statistical techniques to determine 
co-efficients of the model. The technique should presume that the co-~ 
efficients themselves may vary slowly with time as the process continues, 
or at least approach a theoretical limit asymptotically, and utilize new 
data as it arrives to maintain convergence. 

36 In a computer environment, both time and fast-access storage 
are limited, the former by the interarrival time of data, and the latter 
by the less pressing, but real, cost of core storage. There is, therefore, 
an incentive to limit the amount of historical data which must be stored 
and continuously reprocessed, while still maintaining 2 practical level 
of accuracy in generated forecasts. This consideration limits the appli- 


cation of exotic curve-fitting techniques, which can require considerable 
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amounts of cdeceeni ue time, and most of the relevant historical data. 
Since data tends to accumulate with time, storage limitations can become 
significant. One might presume that the relative significance of data 
decreases with its increasing age, and the availability of new data. It 
would therefore seem preferable to accumulate the statistical significance 
of past data in a relatively small amount of storage, and discount all 
past data as an aggragate as new data Bieinees The statistical process 
then becomes essentially recursive, in which new aggregate statistics 
become a function of new data and previous aggregate statistics. 

A standard technique, known as "exponential smoothing", employs these 
principals. Rather than present a derivation of this technique, a sum- 
mary of relevant models is presented: 

i; Single-Exponential Smoothing, a constant Model. 

The constant model presumes that the monitored process is es- 


sentially constant in time, and is described by the equation: 


E(t) = ao 


The smoothing statistic is single-exponei ial: 


SO) = fx] + BISE 


where, 


G=1- x 


and, 


S00 = a,(0) (essentially an e‘timate), 


and x(t) is an observation taken at time, t. The "smoothing constant, O, 
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ranges from 0 to 1 and governs the decay rate of past observations. 


Observations are presumed to be equally spaced in time. A forecast of 


time periods from time, T, projected at time, T, is given by, 


Re = 54 (*) 


2* Doub le~-Exponential Smoothing, a linear model 


The linear model presumes that the monitored process is sub- 


jected to constant trends in time, and is described by the equation: 


E@) = Ap + At 


The smoothing statistics are double-exponential: 


St = exe] + BG 6] 
Sho = «<[Sfo]+ abe oy) 


Initial conditions for the statistics are: 
S% = 2.0) - £0) 
SFG) = 420) -2Ea,@) 


a forecast made at time, T, for periods ahead in time is given by: 


Z(t) =(2 +% © SO] - 6 +) [SP 


S. Triple-Exponential Smoothin a quadratic model 


The quadratic model presumes that the monitored process is 
subjected to a constantly-changing trend in time (which may, in fact, 
be zero, the trivial reduction to the linear case). The model is described 


by the equation: 


E(t) = % + at + 4a,t? 
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Initial conditions for the statistics are: 


3 : ix) = ao) -|8}a,@) + [Pe-l a, (6) 
S% = 4,6) - Ze] Q,(0) + [28629] a,, (0) 


6c) = 
SO) = 200) [SE] ao) + | 384539} a. (0) 
A forecast made at time, T, extending periods into the future with 


respect to time, T, is given by: 


x)= a.(1) a a,(T)t a 4, a(t 


(r= 3.520 -35P'@ +3520 
4,(T) = $5165) Ss) -266 409) SW) -(4-309) SG) 
8,(1) = [S200 -2 5°) + S00 


The primary advantages of using higher-level smoothing functions are 
twofold: | 
Ly Given that the behavior of process can, in fact, be ap- 
proximated by a mathematical model, the higher-order terms will describe 
higher-order (presumably decreasingly significant) effects, and result in 
a more accurate forecast, especially for times relatively "distant" in 


the future. 
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2. ‘The response time of the model to changes in the process 
being monitored, as reflected in the co-efficients of the model, is 
shortened, 

Some disadvantages of using excessively high-order functions are: 

1. The increased storage and numerical analysis attendant to 
generating a forecast. 

2. A tendency toward unstable erariaienes in the model when the 
monitored process changes sharply. This effect is usually noticed when 
the co-efficient of the model vary significantly from those which theoreti- 
cally describe the process. In attempting to correct itself, a high- 
order model will respond fast, but does so at the expense of a series of 
over-corrections. 

For the purposes of this study, it was felt that the condition of 
constantly-changing trends was sufficiently sophisticated to serve as a 
"first-approximation" model. 

One problem which was encountered with all referenced exponential 
smoothing methods is that they presume that data is sampled at regular 
intervals, causing the regular geometric decay of past data with time. 
However, if data is not so sampled, but rather, received at irregular 
intervals, then the geometric decay itself occurs irregularly, with a 
consequent introduction of randomness of sampling not assumed in the 
original equations, resulting in a commensurate loss of accuracy. In 
order to achieve a decay of past data proportionate to its age, the 
standard smoothing constant, ©€ , is modified to a "smoothing function" 
of time-lag between the last reception of data and the "present" recep- 
tion. In order to maintain an exponential decay with time, the smoothing 


function, of: will be defined as follows: 
at 
a= ie 
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in which, 

CC is a fixed constant between 0 and 1 inclusive, and represents the 
unmodified, or "pure'' smoothing constant, tp is a time unit, (which will 
be defined for purposes of argument as the "time-base''), in multiples of 
which the actual time-lag may be specified; 

a8 is the time-lag between reception of current data and the last 
reception of data. 

A decrease in oC » a decrease in es » Or an increase in At ; 
will all serve to decrease the significance of past data. In an obvious 
manner, ive 1 oc 
ees 
and @¢ * and B * are substituted for@¢ and Bas appropriate in the above 
equations. Tre is a slight flaw in the above approximation from a 
rigorous standpoint. The mathematics involved in the derivation of the 
smoothing relationships presume that ©&€ and B are Dear eot The above 
approximation makes them time-dependent. It is possible to propose other 
decay relationships to allow for the continuous arrival pattern of data. 
For the purposes of this paper, and the sample implementation, a rigorous 
and exact solution was not employed. A distinct reduction of average pre- 
dictive error in sample data resulted from the use of this approximation, 


and it might be further reduced by a rigorous solution. 


B. DISCUSSION OF GRAPHS 

bs Figure 2 is a plot of one commodity option, May (1970) Idaho 
Beeetocs, traded on the Chicago Mercantile Exchange on January 27, 1970, 
as reported by the Exchange ticker. Plotting symbols are as follows: 


(1) Offers to sell (ask) are indicated by "+"; 
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FIGURE 2 


(2) Offers to buy (bid) are indicated by "="; and, 
(3) Completed transactions are reported ee nom 

A sparcity of data in the 11:00 to 11:30 region eenudied from missing 
sections of the ticker tape used as raw data. 

2. Figure 3. 

Figure 3 displays the effect of various time-bases upon the 
effective smoothing constant for a typical inter-data time lag, in this 
case, of approximately seven seconds. Sample time- bases of 1, 5, 10, 
50, 100, and 500 seconds were used, and are indicated as such on Figure 
3. It will be noted that the effective decay (SMOOTH ING CONSTANT (MODF)) 
is significant for low values of the time-base over the entire range of 
the smooiling constant ("SMOOTHING CONSTANT (PURE"'), whereas it is al- 


most negligible in the 100-second and 500-seconi time-base region. This 


is expected from the exponential function of equation, 


3% Figures 4 and 5 


Figures 4 and 5 demonstrate the mean relative error for the days 
transactions in this commodity for various unmodified time-base-modified 
values of the smoothing constant. This mean relative error is determined 
by Pecnetating a forecast equation as each new EIU is "received" for 
this option, and determining the mean error of the remaining known data 
points. Obviously, the analysis is designed such that this advanced data 
is not used in making a prediction, only in eetocite the accuracy of 
that prediction, A mean error is recalculated from the "beginning of the 
day" for smoothing constant values from 0.01 through 0.99 inclusive, and 
the smoothing constant is, in fact, held constant through a days evalua- 


tion for that constant. Although spikes are noted at various points on 
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FIGURE 3 


both graphs, this indicates an unavoidable data dependency, and in itself 
indicates only that exponential smoothing is an accurate technique under 
certain conditions. However, it will be noted "by eye" that a time-base- 
modified smoothing constant has a significantly lower mean error than an 


unmodified constant. 
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APPENDIX C 
TEXT PRE-PROCESSOR 


As has been previously mentioned, an ideal text preprocessor might 
be one which optimized a trade-off between scan-length and maintenance of 
system state indicators. Work was abandoned on the implementation of a 
text editor as not contributing enough dieecels to merieé the effort. [t 
is, nevertheless, an integral part of a functional system. 

To provide test data to simulate an exchange interface, a combined 
SNOBOL and FORTRAN job processed raw ticker text from the Chicago 
Mercantile Exchange, and converted it to pre-defined information units. 
In a real-time system, this approach would prove extremely inefficient, 
both from the standpoint of core and time. This program listing, as 
well as a half-hour segment of processed data for five commodities, is 


included for reference only. 
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APPENDIX D 


SAMPLE IMPLEMENTATIONS 


A. SUBROUTINE DESCRIPTION 

In the sample implementations, subroutines were written to perform 
certain data and file manipulations as will be described below. Emphasis 
was solely upon data summarization, x storage and display; no attempt was 
made to implement user-position-monitoring functions, and functions which 
purported to interpret data other than by exponentially smoothed fore- 
casting. 

i. Subroutine BIRTH 

Subroutine BIRTH initiallized the graphic overlay files, graphic 
display device and other bookkeeping functions of minimal significance 
from a general standpoint. It basically effects a "coldstart" upon the 
system. 

2. Subroutine MNITR 

Subroutine MNITR served as an experimental User Interface. 
Its function was two-fold: 

a. Accept user requests in the form of light-pen indications 
of desired information, reset system state and branch parameters as ap- 
propriate and return to mainline. Mainline will overlay suitable 
routines into core to process request. 

b. Allow user to control Exchange Interface for test purposes 
of program, by accepting a request for 1, 10 or 100 exchange information 
units (EIU's) through 2250 programmed-function keyboard. 

3. Subroutine RECVR 


Subroutine RECVR serves as an experimental Exchange Interface. 
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It accepts EIU's in a standard format from pre-processor simulator file, 
determines whether option is being monitored, and sets system state and 
branch variables as appropriate. 
4. Subroutine UPDTE 
Subroutine UPDTE perferms functions described in Priority Levels 
One, Three and Five as follows: 
a. It updates suitable historical graphic overlay files, 
b. It updates the "time" line displayed by the resident 
graphic data set. 
Ce It updates appropriate exponential statistics and 
calculates co-efficients of a quadratic forecast model. 
ad. It erases and regenerates appropriate predictive 
graphic overlays . 
De Subroutine HIST 
Subroutine HIST processes a user request for a new historical 
graphic overlay. It is one of the functions of Priority Level Two. 
6. Subroutine PRED 
Subroutine PRED processes a user request for the predictive 
graphic overlay of a commodity option whose historical graphic overlay 
is already being displayed. It is also one of the functions of Priority 
Level Two. 
ide Subroutine ALPHA 
Subroutine ALPHA permits the user to change the predictive 
smoothing constant (See Appendix B) while the system is in use, 
8. Subroutine TBASE 
Subroutine TBASE permits the user to change the "time-base" 


(See Appendix B) while the system is in use. 
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Subroutines HIST, PRED, ALPHA and TBASE are designed to be over- 
layable when called. Once their function is completed, their storage 
may be released. 

aS Subroutine DOWN 

Subroutine DOWN effects an orderly "normal termination" of the 
system. It transfers direct-access graphic ouepliay files to pened aii 
offline storage media. It rewinds raw EIU storage media. It stores most 
system parameters necessary to effect a warmstart. It should, but does 
not (because the warmstart feature was not implemented) store all common 
blocks except those established by the Graphic Subroutine Package (GSP) 
to point o certain core-resident tables used by GSP. A warmstart would 
be effected by reloading all common blocks and reinitiallizing the 2250 
graphic display unit. Finally, the subroutine produced significant 
statistical data which will be used by subroutine BIRTH the next time the 


system is coldstarted. 


B. DYNAMIC OVERLAY CONSIDERATIONS 


The dynamic overlay effected by OS/MVT is as follows:* 


CONTROL LEVEL LEVEL 
SECTION ONE TWO 
"COMMON" 1. BIRTH 1. INIT1 
HASH 2. INIT2 
3s INLTS 
4. INIT4 
3s ENETS 
6. INIT6 
2. PRED 
3- HIST 
4. ALPHA 
5. TBASE 
6. RECVR 
UPDTE 
MNITR 


The Control Section occupies core at all times, consisting of the 
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mainline, "COMMON", and a hash-code generating subroutine, "HASH", 

Only of the six Seune of Level Two may occupy core at any one time, and 
a subroutine called from mainline at this level overlays any subroutines 
previously in that storage region. The first five subroutines of Level 
One are infrequently called and are logically independent. The sixth 
group of three subroutines, MNITR, UPDTE and RECVR are called every time 
a new simulated EIU is to be processed. From the standpoint of speed, 
these routines will be core-resident as a group a large percentage of 
the time. 

Similarly, initiallization subroutines on Level Two are logically 
independent, other than that they must be called by BIRTH sequentially. 
Resort to overlay did not significantly affect the core, reducing the 
occupied region by about 20% (from 150K to 120K), This is due primarily 
to the operating structure of the Graphic Subroutine Package, which oc- 
cupies a very large block of core permanently under OS/MVT. In a more 
specifically-designed environment the above overlay structure souls 
reduce the core-storage requirement significantly without significantly 


affecting operating efficiency. 
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4 oe FIGURE 6 


IBM-2250 display of August Live Cattle at about 10:40 a.m. Resident 
Display includes "LAST ACTION", "FOR", "AT", and "ACTIVE OPTIONS" table; 
also "SALES" and "VOLUME" axes and continuously updated "time" line. 
Historical overlay, paged into buffer by pointing light pen at one of 
mnemonics (e.g., "LCQ"), includes "SALES" points, "VOLUME" lines, verti- 
cal axis lables for "SALES" and "VOLUME", and "LAST ACTION", "FOR" and 

"AT" entries for option. Predictive overlay, paged into buffer by pointing 
light pen at "FORECAST", includes "ALPHA", ''T-BASE'' parameters, and fore- 
cast line. 


Figure 7 shows complete day's transactions. 
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FIGURE 8 


Closeup of displayed textual information for commodity option in 

figure 6. Historical information reveals that "LAST ACTION" was a 

"SALE" for 31.15 cents per pound, which occurred at 10:35:54 a.m. Pre- 
dictive parametric information reveals that unmodified smoothing constant, 
"ALPHA" is 0.500 and that the time-base "T-BASE" is 300 seconds. All 
parameters and information in this frame are unique to specific options, 
and is paged into buffer when designated by user. 
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FIGURE 10 


Display of all historical action for February Eggs (EG) for January 
27, 1970 on Chicago Mercantile Exchange. 


ie 


FIGURE 11 


Display of all historical action for August Pork Bellies (PBQ) for 
January 27, 1970 on C.M.E. Note "0" at approximately 10:30 a.m., 
which indicates to user that "graphic overflow" has occurred at that 
time, because data point exceeded defined axis range. (A “U" will 
appear on horizontal axis in event of underflow). Repeated over- 
flows or underflows would indicate needfor re-definition of range. 
Missing data in 11:00 to 11:30 range results from incomplete ticker 
tape used for system test. 
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FIGURE 12 


~ Enlarged view of "ACTIVE OPTIONS" table for Figure 11, shown at approxi- 
mately actual size. "FORECAST" is turned on (indicated by asterisk) and 
off by touching word with 2250 light pen. "INTFCE' activates Exchange 
interface through 2250 programmed function box, transmitting 1, 10 or 
100 test EIU's to system. Touching "SHUTDOWN" causes normal system 
termination. Touching "LCQ", "LHM", etc., causes historical overlay 
activated option to be paged into the buffer, and is indicated by asterisk. 


Subsequently touching "FORECAST" will activate and display forecast for 
this option. 
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